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ABSTRACT 

A study examined the content and form of third- ^ 
fourth--, and sixth-grade students* verbal interactions while working 
in cooperative groups. Teachers were asked to conduct 
cooperative-learning reading lessons during the observation time. A 
total of 32 observations of students* cooperative group work were 
conducted in six classrooms during regular whole-language literacy 
instruction. Content of students' verl:^ interactions was examined in 
terms of four general categories: procedural^ academic^ 
individualistic, and social/emotional. The form of students' 
discussions* was examined in terms of the length of their utterances. 
Form was examined to describe the structure of the various types of 
verbal interaction content r and also to ascertain the extent to which 
students » utterances facilitated or hampered discujsion of high-level 
academic contents Grade level and teacher effects were examined for 
both content and form. Analysis revealed that much of the students' 
group discussion could be characterized as on- task and non-negative 
in tone. Results indicated high amounts of procedural and academic 
talk and relatively low amounts of individualistic and 
social/emotional talk. The greater mean lengths of academic low-level 
and high-level utterances suggest that these two categories of 
discussion content are distinct from most or all other types of 
utterances. (Four figures and seven tables of data are included. 
Twenty-six references are attached.) (Author/MG) 
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Gx)perative Interactions ^ 



This study examined the extent and f<ma of third, fotrth and sixth gr^ students' 
verbal interactions while woildng in ooopoadve groups. A total q{ 32 observations of 
students' coq^mtive groupworic was coiKiucted in six classrooms during regular whole- 
language literacy instruction. 

TTic content of students' verbal interactions was examined in terms of four general 
categories: Procedural, Academic, Individualistic and Social/Emotional. These verbal 
interacti(m categ(»ies were furth^ dividoi into a total of ten subcateg(»ies to provide a 
comprehensive description of the types of content discussed in coc^jerative groups. 
Particular attention was focused on Academic discussion ccHitent as prior research has 
shown it to strongly associated with achievement gains for coqjerative group 
participants. 

The form of students' discussions was examined in terms of the length of their 
Utterances. Form was examined to describe the stmcture of the various types of verbal 
interaction (x>ntent, and also to ascertain the extent to which students' utterances facilitated 
or hampered discussion of high-level academic content Grade-level and teacher effects 
were examined for both content and form. 

Evidemv is presented that much of the students' group discussions could be 
charactoized as on-task and non-negative in tone. In additic»i, Acadonic content 
con^rised a substantial portion discussions, but was mostly of low cognitive 
complexity. High-level academic utterances were found to be the tongest utterance type by 
far. Interpretarion of the findings of this study is offered along with recommendations for 
future research. 
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An Analysis of the Content and Form 
Student Interactions in Cooperative Groups 



The obj^tive of this study was to examine die nature diixd, fourth and sixth 
grade students' verbal interactions^ while w<»idng in co(^)erative groups under naturalistic 
conditions. Students in this study were enpg^ in reading and writing tasks as part of 
their literature-based reading programs. Audio reccHtiings of student groupwork and field 
notes on student behaviOT and the instructional setting were the sources data. This study 
examined students' cooperative group discussions in terms of their content and form. 
Content was analyzed using the Taxonomy o f Verbal Inter^tion Content (Table 1) which 
was develops fot this study drawing upon Kalkowski (1988), Sharan and Shachar (1988) 
and Webb (1988). Form was considered in tenhs of the length of student utterances. 
Evidence is presented that while the great majority of students' verbal interaction could be 
classified as on-task (StalUngs, 1980) and at least non-negative in tone, the content and 
fonn of those interactions were such that they appeared to offer limited oppcHtunity to 
leam. 
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Cooperative Interactions 



BACKGROUND 

The term ax^rative learning ^iies to a family of instructicaial api^aches rather 
than to one specific method. The various coqjcrative learning approaches differ 
substantially in their structures, but tfiey all depend on students helping each othff to learn 
within their groups. Some of the approaches can be used across subject areas <cf. Johnson 
& Johnson, 1975; Sharan & Sharan, 1976), while others are subj«:t-q>^fic (cf. DcAvila 
&. Duncan, 1980; Shvin, Leavey & Madden & Famish 1986). The common elen^nts of 
cooperative learning approaches are that they all involve a) grtnips ranging from two to six 
students, who b) work together to learn academic content and skills, with c) little ot no 
diTKrt teacha- instruction during groupworic The term cooperative learning will be us«J 
generically in this papa* to refer to any instructional aj^roach which ra^ts these oitcria^. 

Coop«ative learning is being widely us«i in the United States and to a lesser extent 
in other nations as weU (2Segler, 1981; Slavin, 1988; Sharan & Shachar, 1988). Dishon 
and Ol-eary (1984) state that, Tens-of-thousands of teachers throughout Noith America 
are now beginning to utilize cooperative learning strategies in their classnxjms (p. vii)." 

Cooperative learning is designed to pionK>te cognitive outt:omes such as enhanced 
academic achievement, affective outcomes such as higher self-esteem and academic 
motivation, and social outcomes such as improved cross-racial, -ethnic, -gender, and - 
ability level relations (Johnson, Maruyama, Johnson, Nelson and Skon, 1981; Slavin, 
1983a). According to Slavin (1983a), die positive outccanes of coopeative learning are 
predicated upon eliciting cooperative behaviors &om students through cooperative task and 
incentive structures. Coop^tiw behaviors inclide suj^xsting and encouraging 
teammates, asking for and providing explanations, sharing materials, lis^ning and taking 
tums. These behaviors are {fesigned to provide more m: Jemic, affective and social 
suppon than is typically available from a single teacher using a direct instruction ap,'5roach. 



Cooperative InteracQc»is 

Cooperative task structures dther permit or necesdtate that students work together on their 
assigntnents (Graybeal & Stodolsky, 1985). 

There is growing evi(tenc% that co(^>earative learning can be eff^mve in iscsnoting 
acadonic achievement Extensive reviews by Jdinsc»u et al (19S1), Newmann and 
Thompson (1987), and Slavin (1983b & 1989) have found positive ^evement effems for 
cooperative learning over ccmtrol conditions (usually imlividualistic and/cff competitive 
incenti>« sys^ns widi direct instns:tion) in rcmghly two-Mrds of thne studies examined. 
There are several limitations to this genmlly eiK^uraging r^earch on coqioative learning. 
Graybeal and Stodolsky (1985) have noted that the pr^nderance of research on 
cooperative learning has been in the form of intersrenticms by *iniversity re^archers in 
school classrooms or laboratory studies, neither of which provtcks a contextualized v of 
this approach as it is enacted by groups of students and teachers under naturalistic 
conditions. Addidonally, the ma^ty of cooperadve learning studies use tradidonal paper 
and pencil fi^post measures to assess student change but do not systematically examine 
what occurs in student groups during cooperadve lessons. As a result* litde is known 
about the content and fcmi of student interactions during coof^rative learning %ssions. 
Since coopo^tive learning lis highly dependent for its success on the quality of student 
interactions, it is im{K»iant fc^ research to examine those interactions as well as the natural 
contexts in which they occur. 

Bossert (1988-89) sugge^ that research on cooperative learning needs to move 
beyond traditional modes of assessment and, "begin to peer into the black box of classroom 
interaction and study mediational pnx:esses directly (p. 235)." This study focuses on the 
m^ational process of students' cooperative group discussions and dieir cognitive, 
affective and social components. 
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Verbal Interaction in Coqierative Learning Groups 
Webb (1988) reviewed nineteen sttKli^ which examined students* intcractiom; i .i 
cooperative groups in math or computer sdcnoe classes in grattes 2 thnnigh 1 1. 
Contrdling for ability. Webb idottified a number of types of help-giving/rKdving 
intmctions as predictca^ of academic achievement Amcmg her findings mh^c that, a) 
giving High-Lcvel elabwations (^plaining how to perfcmn a mental qjeration) is strongly 
associated with achwvcment gains; b) recemng High-Level elaborations is ai best, 
modoately associated with achievement gains; c) giving Low-Level help (a single answer, 
m procedural information such as the page number) is xm related to achievement; and d) 
receiving Low-Level help is associated with negative achieven^nt outcomes. 

Work by the Johnsons and their colleagues lends furthw support few the value of 
students verbalizing complex cognitive explanations in their groups. An experimental 
study by Johnson, Johnson, Kerson and Lyons (1985) tested the value of academic 
controvCTsy by randomly assigni'-g fourth- through sixth-grade students to (^operative 
learning groups with either controv»sy or «>ncurrcncc-seeking conditions. All the groups 
were to prepare repeats synthesizing their views on (xmtrovmial social studies issues such 
as alternative versus traditional energy sources. Concurrence-seeking groups were given 
pro and con materials and instructed to share ideas, compromise quickly and not argue. 
Students in controversy groups were divided into pro and con advocates, given materials 
for their own positions only, and were told to support their positions and change only if 
convinced. Students in the controversy «)ndidon sccaed higher on achievenKnt motivation 
and on immediate and dela)^ assessments of achievement and posp^ve-taking ability. 1 

The wx>fk of Webb (1988) and Johnscsi. et al (1985) indicates that high quality 
cooperative group discussions contain detailed, cognitively complex exchanges regarding 
academic content Webb's (1988) review provkJcs strong evidence that it is important for 
students to verbalize their knowledge in their axjperative groups in the form of hi^ 
cognitive level explanations. While Johnson, ct al's (1985) study did not examine 
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interactions within groups, it offers strcmg evklence that prolonged discussion of 
understanding and reasoning regarding con:q)lex issues can contribute to lasting cognitive 
and affi^tive outcomes. Kagan (1986, p. 254), citing the Idinson's research along with 
Bloom (1964) aiui Bnu»r (1961 & 1966), fui^ asserts, "Conoplexity and variety of 
input [provided by students to their teaosnas^] leads to higher level cognitive 
developnKnt" Further supiK^ Ich' the assodaticsi of cooperative learning wi& cognitive 
complexity can be found in Newmann and Thompson's (1987) review of of cooperative 
learning studies in secondary grades. In the eight studies which differentiated between 
low- and high-level cognitive objectives, Newmann Thompsou (1987) found only a 38% 
rate of significant achievement m low-level objectives while, '*In contrast, all cooperative 
methods showed exceptional, even monumental, advantages for higha* (^gnitive items... 
(p. 8)." It appears from the wotk of Webb (1983), Johnson, et al (1985), and Newmann 
and Thompson (1987) that ojoperative learning is esp^ally effective when it involves 
group discussion and tasks focusing on high cognitive level content 

Sharan and Shachar (1988) examined the content and form of eighth students' 
verbal interactions and academic achievement under instructional conditions of cooperative 
learning and direct instruction in an I^eli school. Sharan and Shachar compared five 
classes using Croup Investigation (GI; Sharan & Sharan, 1980) and four which utilized 
traditional whole class (WC) insmiction. Two-thirds of the students were of Western 
extr^on (Eim^)ean, South or North Andean and South Africa) and middle class, while 
one-third were natives of the Middle East and Iowa* class. Middle Eastern students were 
geno^ly at a disadvantage both socially and academically in this and other Israeli schools. 
Sharan and Shachar found that students from both grouf^ spoke more in terms of total 
w<^ and words per turn of speech in the GI classes, widi a lcss& differentiai between 
groups indicating a gain in status f(x the Middle Eastern stu<knts (Cohen, 1984). Students 
in the GI condition also verbalized significandy more cognitive strategies, which offers 
significant cognitive benefits (Webb, 198S). Another finding of note in this study is that a 
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Coopoative Interactions 

significant amount of tfic variance in students' achsevement scores was accounted fcs in 
regression analyses by the types of verbal interactions in which they participated. 

Despite the evkien(% that it is impcmant for stiKiaits to veibalize their knowledge 
and strategies in cooperadve groups, rc^arch suggest that discussion <^ ar<idefnic c(mtent 
does not omiprise a large pan <^ students' coopoative group interactions. Kalkowski 
(1988) obs^ved and analyzed elementary school snuknts' coc^;erative discussions over a 
two year poiod and found that ac^emic «Hitent accounted fm 28% of all verbal 
into^tions: 7% - requests for informaiicKi(requcst fca* information not necessarily 
accessible to each memba-, usually acad«nic in nature), aiKi 21% - inforaiadon-supply 
(supply of information not ntcessarily accessible to each member, usually ^ademic in 
nature; p. 7). The other types of ve-bal interaction she found were: 29%- 
sociaVenxjtional; 21% - procedural supply; 8% - noncaiegorizable; 5% • procedural 
demand; and 4% - procedural request Examining Kalkowski's( 1988) findings further, it 
is apparent that only 21% of the students' intoacticMis (information supply) could have 
been of high cognitive level. Furthermore, it might be fair to hypottesize that a large 
pn^xation of the infomiation-supply interactions were of low cognitive level since the 
prepcMiderancc of total interactions concwned non-academic content Since Kalkowski 
(1988) did not distinguish between low and high cognitive level academic content it is 
impossible to establish the i^rcentage of the students' interactions which were of high 
cognitive level Additionally, we do not know just how hi^ a percentage of high level 
interactions in a cooperative group is qstimal. At any rate, Kalkowski's (1983) findings 
suggest that students may not discuss academic content at a high cognitive level as much as 
would seem desirable in their cooperative groups. 

Blumenfeld and Meece's ( 1988) recent study of science instruction in fourth 
through si.\th ^adt classes offers further evidence that stucknts in coop^tive grou[» may 
not engage their academic content at a high cognitive level as much as would seem 
desirable. Through post-instruction questionnaires, they found students reported using 
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fewo- high-level cognitive strategies in kssons which involved smaU group leaming ^ 
which were in other ways procedurally complex. 

Hie challenge faced by sttutents in coc^erative leaming groups as they attempt to 
discuss their acadenuc content should not be underestimate. Students in cooperative 
groups must construct a participaticm structure which differs substantially finom ihc modal 
recitation format (cf. Bellack, KUebard, Hyman & Smith, 1966; Ckxxllad, 1984). A 
cooperative group participation structure in which mentos fi^y and regularly share dieir 
knowledge and strategies may be quite incomprehensible to students who lack prolonged 
exposure to it Mehan (1979) has examined classnxnn intenu^cms in teacher-directed, 
large- and small-group di»:ussions during Uto^y instruction and noted that in cmkr for a 
student's verbal inter^ticm to be successful (to be incorporated into the flow of the 
discussion) it has to be i^jHopriate in both ointent and fomn. Mehan found that the manner 
in whirh classroom rules were mutually constructed and used by the teacher and students in 
his study facilitated the exchange of certain ^p^ of infoimadon and inhibited others. 

Students in cooperative groups may also establish rules, <^ norms, which facilitate 
discussion of particular types of content and inhibit others. The work of Johnson, et al 
(1985), Newmann and Tliompson (1987) and Webb (1988), suggests that it would be 
desirable for students in coq)erative groups to focus a significant amount of their 
discussicms on high cognitive level academic content. One way in which coo^radve 
groups may either facilitate or inhibit discussion of high cognitive level content is in the 
length of the student utterances. An imenuu^ w31 be defined as an uninterrupted turn of 
talk by one stucknt. The complex explanations required to justify opinions in Johnson, et 
al*s (1985) study, (h* to elaborate on cognitive operations as in Webb's (1988) review, 
would ^m u> require fairly long unerances by students. That is, students must have 
available, and utilize opportunities to explain their reasoning in detail in ord^' f(^ 
cooperative group discussions to include exchange of high cognitive level content 
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Cooperadve Interactions 

Therefore, ihcform of students' verbal interactions - in terms of the length of their 
utterances is important in addition to the content of those interactions. 

Whole Language Instruction 

The whole-language, or literature-based, approach to literacy instruction would 
seem to offer students an i^sl 0{^oitunity fo discuss academic content at high ^^tive 
levels. The whole language approach involves the study and use of written and 
language in the context of authentic tasks (Goodnmn« 1986). Authentic tasks are tasks 
which serve a genuine ccmununic^tive intent of the individual student, such as reading a 
trade book which s/he has ch(Kcn or writing a lette- to a fhend (Pearson, 1989). Whole 
language instruction requires students to spend extensive classroom time reading and 
writing, both alone and in conjunction with peers and the teacher. Whole language 
instruction, like cooj^rative learning, relies on discussions to allow students to construct, 
reinforce and apply learning, in this case through dialogues about text. Pearson (1989) 
notes that in a whole-language program, "an active inteipredve (immunity is necessary in 
order to support comprehension (p. 234)." 

Cooperative learning groups offer a structural means for increasing dialogue 
opportunities within the whole language classroom since a number erf student-run groups 
can opo^te simultaneously. Whole language reading programs provide students with an 
interpretive orientation toward learning conducive to high cognitive level discussions, while 
cooperative learning provides a stricture for guiding students* group processes. It must be 
noted diat verbalization di Iowa* <x>gnitive level »;ademk; content is quite appn^ate in 
reading instruction in additicMt to high-level content For example, oral reading provides 
students with an opportunity to develop fluency and comfs^hension Pahl, 1972; Perfetti, 
1985). Oal reading by itself, without accompanying discussion of comprehension or 
strategies, would be considered low cognitive level verbal interaction content (by the 
cri^a being used in this study. Table 1). Therefcm;, high-quality cooperative group 
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Ccx>perative Interactions 

discussions in a whde-language classtxnii would likely contain substantial amounts of 
both low and high cognitive level verbal intf^ractions. 

A Taxonomy of Verbal Interaction Content 
The Taxonomy of Verbal Interaction Content (Table 1) was developed for diis 
study in order to provi(fe a ccsnprehen^ve firamework for examining the c<^ient of 
students' cooperative group discussions. This taxonomy expands upon KaUcowski's 
(1988) by drawing upon Sharan ami Shachar (1988) and Webb (1938) to consider 
cognitive complexity. Oth^ modifications were drawn from Shar^ and Shachar (1988) 
and Slav in (1983). Verbal interaction content was examined in terms of four general 
categories: Procedural, Academic, Individualistic aiui Social/Emmional. Each of i^ese 
general categories was divided into two a* rtK^tc subcategories u>talling ten in all. 

The Procedural content category of verbal interaction concerns issues such the 
proper format for completing a task or the division of labor within the group. From 
Blumenfeld and Meece (1988) and Kalkowski (1988), these issues wouki appear to be 
major coni^ms for students in cooperative groups. The Procedural category was divided 
into the subcategcmes of Nondirective and Directive to dilffsentiate l^tween questions or 
suggestions versus imperatives. The final Procedural subcategory. Attempt at Closure , 
refers ^o suggestions or imperatives by students designed to bring discussion of a particular 
topic to an end. This subcategory was ackied to the Procedural category during the course 
of data collection when the salience of this type utterance was noted in several classroc»n 
observations. Groups in several observations were observed to huiriedly vote m 
n^mbo^' ideas rather than discussing them in detail, thus mitigating against cognitive 
complexity of discussions. ITie Procedural Attempt at Closure subcategory is subsun^ 
under both the Nomiirective and Direcdve subcategcaies; no attempt was made to 
differendate l^tween nondirecdve and directive attempts at closure. 
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The Academic content categoiy includes any verbal inter^tton that invdves 
cogp'*ivc opcratiwis. The subcategories of Law-Level and High-Level ccHitent, along 
with Rr jests for Ir^onmHon arc included within the Academic categ<^. As with 
Webb's (1988) review, Low-Levd content refers to statenwnts which include only 
infbnnation without an explanation, while High-Level ccmteni indmles both information 
and an explanaticm 0€ reascming. Academk Requ^ include questbns or staten^ts 
soliciting dther Low- m Hi^-Levd academic c(mtent 

ffuUvidualisHc discussion content indu^ any verbal interactic»is which indicate 
that the speaker is diverging ftom die ^demic task as it is bdng engaged by the group at 
that tms. Slavin (1983a) has assoted that one of the es^dal elements (tf ax>perative 
learning approaches is elidting ax^>a^ve as o{^>osed to individualistic behaviors firom 
students. These cooperative behavk»^ include discussing the group's task and helping 
other memben. The Individualistic cc»itent category is divided into two subcategories, On- 
Task ami Off-Task. Individualistic On-Task discussion content includes statements by 
students indicating that they are going to pursue son^ facet of the group's task on their 
own. Individualistic Off-Task content includes any talk that is unrelated to the group's 
task. 

The SociaVEmorional content category refers to any talk that is primarily affective 
in nature. This category is similar to ones used by Kalkowski (1988) and Sharan and 
Shachar (1988). Hie Social^nnticmal category was divided into both Positive and 
Negative subcategories to differentiate between supportive versus perscmally critical 
staten^nts. Criticism of ideas , would be classified as Aci^emic High-Levd if a reason is 
provided, ca* Low-Levd if not 



Purpose 

This study sought to describe and interpret die content and form of third, fourth and 
sixth grade students' coof^rativc group discussions in the ccmtext of their regular literature- 
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based language aits instruct} ra. Discussion content was categorized using of the 
Taxonomy of Verbal Interacti<»i Content (Table 1). Form was analyze in terms of the 
length (number of ymds) of student ut^ances, similar to Sharan and Shachai's (1988) 
procedures. Verbal inten^tion content ami fcarn were examined across all obsovations and 
by grade-level. In addition, content was examined by teacher, while form was examined in 
terms of content category. Grade- level and teacher effects Were investigated in order to 
ascertain the generality d theflndinp as well as to idoitify and interpret sources of 
variance. Fram was investigated in terms of content to identify the average length of 
utterances within the various extent categories. This was done to describe the nature of 
the various types of utterances, with {articular attention to the Acadenuc content 
subcategories. The length of student utterances was examined in this study in order to 
ascertain the extent to v.iiich students h^ available and utili^ of^rtunities to explain 
their ideas and reasoninF in detail. 

The intent of this study then, was to provide an exploratory description under 
naturalistic conditions of the content and form of students' verbal inter^tions in 
cooperative groups. By examining students' discussions in terms of both their content and 
form, with attention to cognitive complexity, insight is provided into the nature of 
cooperative group discussions along with the likelihood of those discussions fostering 
higher order thinking. 
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RESEARCH QUESTIONS 



1. Whai is the distiibuticm of content of stu<fen^' vctbai interaction in cooperative 
groups across all obs«v* ' ^ j^** 



2. What is the distribution of content of students' verbal interaction in cooperative 
groups by ^ade-level? 

3. What is the distribution of content of students' verbal interaction in coop^ative 
groups by teacher? 

4. What is the form (average length of utterances) of students' verbal interaction in 
cooperative groups across all cHj^rvations? 

5. What is the form (average length of utterances) erf students* verbal interaction in 
cooperative groups by giade-levd? 

6. What is the form (average length of utterances) of students' verbal interaction in 
cooperative groups by content? 



METHODS 



Participants 

Five teachers aini six classes of elcnwntaiy school students from a moderate-sized 
city in the West participated in this study (2 third-, 2 fourth- and 2 sixth-grade classes). 
The fourth-grade teacher taught morning and afternoon sections of language arts, and data 
wee gathCTcd in each. All icachos were anglo females and voluntc«ed to participate in the 
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study. The distribution of grade-levels in the study reflects the availability of teacher- 
volunteers. 

Each of the teachers identified l^rself as using Uterature-based a^i^t^ch to language 
arts. None of the teactm rqK>rted utilizing basal reading texts. All of the teachen stated 
that they use cooperative groups as a majcH' omiponoit of Utsacy instnicdon. Es^h of 
them repent^ using somt fcam of cooperative learning at lea^ thr^ times per week. All of 
the participating washers had received the equivalent of at least three semester hours of staff 
development in cooperative learning methods offered by their school district aiid/or local 
universities. As this study was (X)nducted late in the school year, during May, CK>th the 
teachers and their students were presumably quite familiar with this instructional appn^ch. 

The students were predominantly anglo and mickile class, and the classes were 
heterogeneous in ability. Approximately three-fourths of the students in the classes had 
written parent-permission to participate in the study. No data were collected on students 
without parental consent 

Proceduies 

Data were collected during May, 1989. Ti e teachers were told that the purpose of 
the study was to examine cooperative discussions aiid acdvides. Teachers were asked to 
conduct cooperative reading lessons during the agreed-upon observad(»i days but were 
otherwise left to plan the lessons as they chose. The observed les»>ns included: Grade 3 - 
- adapting stories to play format; Grade 4 ~ designing a board game utilizing multi- 
disdplinaxy activities; Grade 6 - stoiy writing fcs- a second-grade bode pal, writing a class 
memory bode, a newspapo* scavenger hunt, and analyzing characters in trade books. 

Each class was deserved on diree days during the same week. Each lesson 
observation lasted between 30 and 60 minutes. During these ob^rvations, descnptionic of 
the curricular activities and %tting were collected along with notes on student behavic^ and 
non-verbal communication. Two researchers were present during each obsovation. Each 
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researcher randomly sdected a different student group each day f<x observation and placed 
a tape recorder near the group so that their discussions ccHild be rec^^ed. A total of 36 
group sessions was observed (6 classes X 3 observations X 2 groups per obsc^ation). 
Technical problems, as well as shorts' ob£«vati(»i$ which permitt^ more than one group 
to obs^ed duHng a session resulted in imbalanced totals of diservations ^:ross the six 
classrooms. The actual total of observations examined was 32 with the following 
distribution by grade and teacher Grade 3) Teach«- 1-5 observations, and Teacher 2-8 
observaticms; Grade 4) Teacher 3-6 obsovations in the a.m., and S d)servations in the 
p.m.; Grade 6) Teacher 4-4 observations, and Teacher 5-4 observations. 

All audio tapes of students' groupwork sessions were transcribed f(^ analysis. 
Field notes were combined with the transcripts to add relevant contextual data. Elements of 
the physical setting such as the arrangen^t and nKivements of students and matoials were 
noted. The socio-emodonal climate was al^ obser.-ed and noted in terms of students' 
nonverbal expressions, conflicts and interaction with other groups or the teacher. 

The students' verbal interactions were cocfed for content as (Hie of the ten 
subcategories of the Taxonomv of Verbal Interaction Content (Table 1). Each 
uninterrupted turn of talk by a student was considered an utterance. Totals of utterances 
and words for each verbal interaction content subcategory were recorded for each 
observation. Utterance and word totals were convert^ into pf^rcentages for each content 
subcateg(^ for each obs^ation. Conversion to percentages was necessary for comparing 
across observations, since the amounts of talk within observations varied. Mean 
percentages of utterances offer insight into the range and distribution of discreet turns of 
talk within the subcategories of vo-bal interaction content Mean word percoitages offer a 
sense of the relative amcHints of discussion time devoted to the various «>ntem 
subcategOTies since utterances vary in length by number of words (as well as by time). 

Students' v^bal intnactions were analyzed in terms of their form (wc^ per 
utterance) in addition to their content. Thac were a few instances in which a single 




Coo{^ative Interactic»is 



utterance omtained distinct elements of two of the content cat^gc^es. In such cas^, the 
utterance was categcaized as two sqmxate utterance TIte rationale for splitting an 
utterance in this manner was that it allowed a tn«r categorization of the coitoit than would 
be the case by sin:q>ly fi»cing it into a single (^gc»y. The drawback was that this splitting 
distc^^&elengthandtotalof utteran(^i in analysis of their fionn. There was few^- than 
one such case per ob^mition, howevo*, so the inq>act of diis uttraance splitting <m the 
structural analysis was d^ned negligible. 

A graduate as»»ant experienced at coding transcripts did all of the co^g for the 
study. A stratified random sample (represendng each grade* teacher and classroom) of 
seven (21.8%) of this rate's <^servation$ was independently coded by one of the primary 
investigators. Pearson Product-Mcsnent correlations of inteirater agreement avmged i = 
.947. and ranged from £ = .882, to i = .991. 

Data Analysis 

Statistical analyses of di^ussion content (Research Questions 1, 2 & 3) were 
conducted for percentages of utterances and percentages of words. To address Question U 
descriptive statistics (mean, standard deviation) were calculated for pocentages of 
discussion content categories and sulK:ategcHies (as described in Table 1) across 
observations. Descriptive statistics wore also calculate by grade-level and by teacho* to 
address Research Questions 2 and 3, respectively. 

In order to assess the significance of differences in distribution of discussion 
con<jent by grade-level and teacher foe Research (^estions 2 and 3 respectively, a saits of 
inferential tests was conducted with an alpha of 12 < .(^ for all tests. Each set of tests was 
conduct! four times: first for utterance data and then ymd data; and with Grade and then 
Teacher as the independent variable. The first step was to run a MANOVA with the four 
genoal vcri^ intoaction content categ(»ies - Procedural (Pro), Acmtotc (ACA), 
Individualistic (IND), and Social^Emotional (SOC) as dependent variables. Each of these 
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dependent variables c-msisted of the sum of its associated subcategory data. Fch* example, 
the Academic categcsy was tlie sum of the percentages fc^ Academic Low-Level Academic 
High-Level and Acsttfemic Requests. When a »gnificant n^dn effect was found fix the 
MANOVA test, univariate-Fs wee inspected to identify which of the ctependent variables 
evidenced graf^^-level (ch- teacher) differences. Finally, post-hoc Schcff€ tests were 
conductKi to idratify whkh gr^es te^tos) were signifkantly different from the others 
on the dependent variables which had showed agnificant MANOVA and univariate results. 
This sequence of tests was then repeated with die ten individual subcategories of discussion 
content (lhtx:edural Nondirective through Social/Emotional Negadve) as dependent 
variables. These procedures were urilized in order to assure tiiat obsaved differences in 
discussitm content were not likely the result of interrelationships am<Mig the dependent 
variables. 

Tlie form of students' verbal interactions was analyze in order to address Research 
Questions 4, 5 and 6. The form of verbal interaction was examined in terms of the length 
of student utterances (total words divided by total utterances). Descriptive statistics (mean, 
standard dcviaticsi, frequency distribution, skewness) of the length of student uttenmces 
were calculated for total utterances across aU observations in wder to answer Question 4. 
Descriptive statistics were calculated by grade-level in order to address C^estion 5. 
Descriptive statistics were also calculated fm utterance length by each discussion content 
subcategory in order to address Question 6. Repeated measures ANOVA tests (ji < .05) 
were utilized to compare uttmnce lengths by pade-levd and by discussion content 
subcategories. 

RESULTS 

The total data base for the study ; msistcd of 6952 utterances and 4831 words. 
Results will be reported in this section organized by the research questions. Discussion is 
withheld until all fmdings have been presented due to their inteirelatedness. 
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Hndings 

For Rese&ich Questions 1, 2, and 3, which address con^t, the findings will be 
presented first in vsitos the four discussion content categories and then proc^ 
to the ten c<»itent subcategories. Utteram^e data ami word data produced nearly identical 
results throughout analy^s peitaiiung to Questions 1, 2 and 3. In the interest of brevity 
and clarity pr^ntation of findings will focus on ut^ram^ data. Result of woid data 
analyse will be presented only where they diffo- fiora results <hi uttwancc data. 

1 ■ What is the distribution of content of student intCTaction in operative groups across all 
observations? 

The descriptive statistics (means and standard d<;viations) for the percentages of 
utterance and wcffds in the four main votal interaction content categories - Procedural, 
Academic, Individualistic and Social^moticnial w:tc aggregated across all observaticms 
(Table 2). These figures indicate that students' group discussions were composed 
primarily of Procedural (PRO) and Academic (ACA) talk, followed by far lower amounts 
of Individualistic (IND) and Social/EnxjdcMial (SOQ talk. The Procedural category was 
most prevalent in utterances at 48.36%, folbwed by Acaifemic at 42.22%, yet the order of 
these categories was revo^ in vfotd totals with Academic higher at 53.16% to 40.83%. 
The IiKiividualistic and Social/Emotional categcm^ of intmokm are ^sistent across 
utterance and word totals with the Individualistic utterance niean of 7.83% and word mean 
of 5.12% both higher than the corresponding Social/EnK^tional means of 1.59% and .69%. 
The Individualistic category o( talk had the greatest variaiK^ in distribution with standard 
deviations greater than its means for both utterances and words. 

Since utterance totals indic^e the number of discreet v«t»l interactions within a 
particular c(»itent category and word totals suggest the relative anKiunts of discussion time 
devoted to the various categories, Procedural content can be seen as the focus of the 
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greatest numb^ of di^reet student interactions, while Acadonic content occupied a 
majmity of discussicMi tiiro. 

A more detailed picture of students' group discussions can be elicited from the 
means and standard deviations of the ten subcategories of interaction content as displayed 
in Table 3. The mean utterance percentages for these content subcategories are displayed in 
Hgure 1. The subcat^csy data indicate diat the major pan of students' Procedural talk was 
ccm^s^ of Nondirective (PND) talk at 42.01% of total utteram^s and 37.13% of total 
words. Procedural Direcdve (PD) talk was far behind Nondirecdve at 5.62% of total 
utterances and 3.36% of total total words. Tlw Procedural Qosure (PCI) category 
comprised only .74% of total utterances and .34% of total wwds. Distribution across 
observaticms of Procedural talk was faiily (insistent for tfie Nondirective (utterance = 
20.52) and Directive (utterance SD = 4.74) subcategories. Only two observations 
contained no Nondirective utterances and these w^ both extronely shon obs^ati<^s. 
Seven observations had no Directive utterances. The Procedural Closure category was 
distributed quite unevenly (utterance = 1.23). witii 67% of the obs«vations having no 
Procedural Qosure talk, while six observations accounted for 73% of these utterances. 

The Academic (ACA) category of interaction content consisted primarily Low- 
Level (A(X) verbal interactions at 35.68% of total utterances and 39.45% of total words. 
Within the Academic ccHitent category, Low-Level talk comprised 90.95% of utterances 
and 74.21% of the words. Academic content High-Level (ACH) verbal interactions 
compri^ 3.61% of total utterances and 1 1.05% of total wends. The Academic content 
High-Level subcategcsy shows the grea^st di^arity between utterance and word 
percentages siiK:e the» utteram:es had ihc greatest rc^m tength {Sts tl» findings for 
Research (^estion 6). Academic Cont»it Requests (AC?) onnprised a small portion of 
group interactions zi 2.92% of total utteram^s and 2.66% of total words. The distribution 
of Academic talk across observations was fairly even fcH- the Low-Level and Request 
subcategcdes ami less so for the High-Level subcategory. Academic Low-Level utterances 
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were distributed across all observaticms except one, which was extremely short, yet were 
quite uneven in distribution as indicated by the high standard deviation - 24.60). 
High-Level uttoaiKes (SD. 7.13) were quite uneven in distributi<Hi across observations 
with 40% having no mch utterances. 

Tl^ Individualistic category of interaction C(»itent was con^sed primarily of Off- 
Task talk at 5.18% of total utterances ccmipared with On-Task ut^rances at 2.65%. The 
w(M totals these two subcategories are mssc equal, however, with Individualistic Off- 
Task at 170% CMily slightly higher tiian On-Ta^ at 2.66%, Utterances within the 
Individualistic categ<^ w^ distribute aot^ss all but ^ observations, yet were quite 
uneven in frequency. Within the Off-Task subcategory, five observations accounted for 
60,36% of the total words (SD. - 4.30). Within the On-Task subcategoiy, three 
observations accounted for 72.60% of die word total (SQ. - 4.87). 

The $ocial/EnK}tional cate^sy of verbal interaction (xmtent had a higher i^rcentage 
of Positive (SE4-) than Negative (SE-) talk at 1.07% to .52% of utterance totals, and .52% 
to .17% of word totals, respectively. The Positive utterances (SD = 1-29) were distributed 
fairiy evenly with 67% of the observations having at least one, and a maximum of ten. The 
Negative utterances (SJ2 = 1-13) were more varied in distribution, with a majaity 
(56.66%) coming fiom three of the observations, while 70% of the observ ations had no 
Negative utterances. 

2. What i^ th e distribution of content of smdents* verbal interaction bv grade-level? 

The distributicm of students' cooperative group talk among the general interaction 
content categories by grade-tevel is displayed by utterances and wonts in Table 4. The 
higher level of Procedural talk (66.01% of uttoances) ami lower level of Academic talk 
(22.74%) for Grade 4 are quite striking. In order to systematically assess the significance 
of differences in mean percentages of interaction content categories by grade-level the series 
of inferential tests (kscribed above was utilized 
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The first MANOVA procedure (for utterances) indicated a significant grade-level 
main effect (£(8,54) = 2,146, j2 < .047) for mean percentages of utterances across the four 
general intottction contoit categories. The univariate-F tests (s|f » 2»29) indica^ 
signiffcant grmie-Icvel effects fos Plroc^ural CE = 7.3(X), u < 003) and Academic (E = 
8.004, 12 < .002). No significant grade-level effi^ (s. < OS) were found for the 
categOTies Individualistic and Social/Emotional talk. Scheff^ lests Gl£ » 2, 29) revealed 
the following gr^-level effects on the mean pen^tages of into^action content: 1) 
Procedural - Grade 4 (M = 66.05%) was significantly highra^ than Grade 3 (M = 
39.92%) and Grade 6 (M = 37.84%), (E = 7.296, p < .0027); 2) Academic - Grade 3 (M 
= 53.21%) and Grade 6 (M « 51.14%) were significantly hi^er than Grade 4 = 
22.74%), (E = 8.005, c < .0017). 

Following the analysis of the four major categories of vei1>al interaction, the ten 
subcategcmes were examined. The distribution of students' utt^ances by grade-level 
anwng the a»itent subcategories is enumerated in Table 5 and displayed in Figure 2. As 
would be expected from the grade-level analysis of the gen«al verbal interaction categories, 
several of the subcategories within the Procedural and Academic categories appear to differ 
substantially by grade. Grade 4 appears quite high on Procedural Nondirective utterances ( 
M - 55.99%) and quite low on Academic Low-Level (M = 17.48%). Additionally, both 
Grades 3 (M = 1.30%) and 4 (M = 1.58%) appear quite low m Academic Content High- 
Level utterances compared to Grade 6 (M = 10.12%). The MANOVA procedure the 
content subcategories (Procedural Nondirective through Social Emodonal Negative) 
indicated significant grade-level effects (£(20, 42) = 2.591, < .005). Univariate F-tests 
(df = 2J19) showed significant grade-level eff«:ts for the Procedural subcategories of 
Nondirective (£ = 4.905. b < .01 5) and Directive (£ = 7.328. fi < .003), and for the all the 
Academic subcategories. Low-Level (£ = 7.668, jj < .002), High-Lcvel (£ = 5.8 !4, 5 < 
.008) and Requests (£ = 5.180, < .012). 




Coq^o^dve Interactions 



The stpificant univariate results were followed with Schelf€ po^t-hoc procedures. 
Significant Schefftf test (df = 2, 29, fi < .05) results within the Proc^ural category were: 
a) Nondim;tive — Gnule 4 was significantly higher than Gnute 3 (on uttn^ces), and 
significantly higl^ than Gtad» 3 ami 6 on word pers^ntage; b) Directive ~ Grade 4 was 
signiflcandy higher than Grade 6. The outc<»n^ of the Scheff6 tests indicate that the 
greater proportion of Procedursl talk for Grade 4 relative to Grades 3 and 6 was due to 
diffiaences in die subcategodf. i Nondirec&ve and Directive talk and not to the Attempts 
at Qosure subcategory. Moreover, ihe word different between Grades 4 and 6 on 
Ncmdir^ve talk, coupled with the lack of an utterance difference, suggests that this type 
of talk occupied a substantially greater jaoportion of discussion time in Grade 4 than Grade 
6, yet not a significandy greater proportion of tq^ics a<kiressed. 

The Scheffii tests (df - 2, 29, p < .OS) of mean percentages of unerances in the 
Academic subcategories by grade-level obtain^l die following significant results: a) Low- 
Level - Grade 3 was hi^er than Grade 4; b) High-Level ~ Grade 6 was higher than 
Grades 3 and 4; c) Requests — Gracks 6 and 4 were higher than Gr^ 3. Hiese Hndings 
indicate that die signiflcandy higher percentages of Acadcniic talk found for Grades 3 and 6 
compared with Grade 4 were due to greater amounts of Low-Level talk for Grade 3 and 
High-Level talk fcs- Grade 6. 

3. What is the distriburion of content of students' verbal interaction in cooperative groups 
by teacher? 

The n&m pscentages of utterances in the general interaction a>ntent categcwies by 
teacher are presented in Table 6. AH data were examined for teacho- effects using the same 
set of statistical procedures as for grade-level effects (MANOVA, univariate-F md Scheffd 
tests) substituting Teacher for Grade as the independent variable. Teachers 1 and 2 wme 
nested within Grade 3; Teachers 4 and 5 were nested within Grade 6; and Teacher 3 was 
crossed with Grade 4, as she taught both classes of Grade 4 students. MANOVA tests 
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yielded nonsignificant results for both utterances (£(16.108) = 1.30. c < .213) and words 
(£(16,72) = 1.299. a<. 222). 

The mean parentages of utterance in ^e ten interacdon content subcategmies 
teacher are presented in Table 7. The MANOVA tea for teacher effects on tte ten 
discusst<m content subcategories f Procedural Nondirective through Social/Emotional) 
found nonsignificant results for utterances (£(40,84) « 1 .366. b < .1 16) and words (£{8. 
36) = 1.138. ji< .363). 

4.-What is the fom faveraee length of utterances! af stu d ents' verbal interaction in 
cooperative groups across all ob s«vations? 

Analysis of utterance length of stud«its' coqjeradve group interaction was 
conducted on a smaller scale than the analysis of content, as fomi was a lesser focus of the 
study. The f(mn of the general discussion content categories of Procedural, Academic, 
Individualistic and Social/Emotional was not considered significant, so analysis proceeded 
directly from overall form, to form by grade-level, to form by subcategories. 

The mean utterance length across all observations was 6933 words. The fairly 
large standard deviation (SH = 7.731) indicates that there was considerable variance in 
utterance length. The strong positive skew QH- 3.965) of the distribution indicates that the 
majority of student utterances were quite short (56.57% < 6,0 words), although there were 
some very long utterances. Qjmbining the first two intervals (of five words each) in the 
frequency distribution of uttaaflce lengths indicates that 82,09% of all utterances consisted 
of 10 words or less. Fewer than 2% of all utterances exceeded 21 woak in length. 
Utterance length ranged from 1 to 101 words. Figure 3 illustrates the frequency 
distribution of utt»ance length. The extreme positive skewness is apparent 
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5. What is the form faverage length of unerances) of students' vo-bal interaction in 

cooperative groups bv grale>ievel? 

Grade-level means f<x uttmnce length showed Gisfie 4 to once again be the outlier. 
The grade-level means for utterance lengA woe as follows: Grade 3» M = 7.947 (SD = 
8.10); Grade 4, M = 6.476 (SJQ = 6.259); Grade 6, M = 7.757 <SQ = 1 U82). A repeated 
measures ANOVA test (dt » 2, 2108, a < .05) with gnde-level as tbr indqiendent variable 
and mean utterano; length as die depencknt variable indicted tliat die uoerance lengths of 
Grade 3 (E = 7.174) and Grade 6 (E = 5,444) were both significantly greater than for 
Grade 4. 

6. What is th e form (average length of utterances) of students' v«-bal interaction in 

cooperative groups bv content? 

The form of utteraiKes in terms of their mean lengths within the ten interacdon 
content sub<^tegcHies is dispiay»l in Figure 4. Pr^ictably, utterances within two of the 
Academic content subcategories - Low-Level (M = 12.254, SD = 15.732) and High-Level 
(M = 24.907, = 19.128) were the longest The only other utterance type with a mean 
length greater than the grand mean was {procedural Nondirective (M ^ 7.141, ^ » 
4.600). The shortest utterance type was Social/Emotional Negative (M = 4.33). 

A repeated measures ANOVA was utilized to ccm^jare the mean utterance lengths 
by subcategories. Pairwisc comparisons revealed the following significant differences in 
utterance lengths (df = 1* 18. g < .05): a) Procedural Qosure were longer than 
Social^nnotional Negative uttmnces; b) Academic Low-Level utterances were longer both 
the Individ jalistic subcategcHies and both the Social/Emotioi^al subcategcnies; c) Academic 
High-Level utterances were longer than all other subcategories. 
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Discussic»i 

Disease. on will be presented first in terms of overall findings (sctoss all 
obsesvadons) regarding v«bal interaction content and form, then in terms of grade-lcvd 
and te^ho' effects. This <rgani^tk>n should help to unravel s ^of ^inmrelated 
findings fOT grade-tevd and teacher effects which pstain to both (intent and form. 

Among the mo^ striking findinp in this study are the high anKiunts of Proc^ural 
and Academic talk aiKi the relatively low anmnts Individualisdc and Socia]^nK>tional 
talk. Also, the lowor amounts of Academic talk, ami sbma uttom^ in Grade 4 
comparwi with Grades 3 and 6 are quite surprising. Finally, the grrater mean lengths of 
Academic Low-Level and High-Levcl utterances suggest that these two categories of 
discus^on content are distinct from nK)st or all other types oi utterances. 

Interaction Content and Fo rm Overall 

The students' cooperadve group vobal interactions in this study could be genorally 
characterized as on-task (Stallings, 1980), group-<»iented, primarily Procedural and 
Academic in focus, and containing only trace amounts of negative comments or "put- 
downs". These are quite positive findings. However, fiin!icr examination suggests that 
the cooperative group discussions observed also have room for improvement The overall 
mean utterance length was fairly short, suggesting that discussion fcmn placed a significant 
limit cm students' oppcstunity or likelihood of expressing implex (X)nc%pts. Also, the 
amount of Aca^temic Hi^-Level taUc was quite low, especially fo^ whole-language reading 
instruction which espouses strategic thinking as a major goal (Pearson, 1989). 

Analyas of the form of students' «x^>erative group interactions indicates that the 
prepondenmce (82.09%) of utterai^es consisted of ten words or less, while a majority 
(56.57%) consisted of five words or less. It is unlikely that such short unerances are 
capable of expressing ctmiplex cognitive thoughts. This contentiim is supported by the 
mean length of Academic High-Level utteran^ at nearly 25 wc^s. Whetiier smdents 
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were simply not thinking in a High-Level manna* which contributed to short utterances, or 
whether shon utterances hampered their abilities to express High-Level thoughts is 
pn^lematic At any rale, d^se data indicate that complex cognitive discussion is composed 
of long utterances and these students expressed few such utterances. 

The preponderance oi Procedural and Academk talk (combined w(»d totals = 
93.99% total) in th^ observaticHis indicates that fcH* die most part, students were 
engaging in their learning tasks a great deal of the time. The majority of discu ision time (as 
indicated by the word mean of 53.16%) was con^ris«l of Ac^endc content, the gen^ 
type of interaction most closely associated with higher achievement (Johnson, et al, 1985; 
Newmann & Thompson, 1987; Webb. 1988). Compared with Kalkowski's (1988) 
finding of only 28% academic talk (21% informatiOT supply + 1% infomiation request ), 
this is quite encouraging. At the same time, the levels of Individualistic mlk were quite low 
(5.12% of words), indicating that students were generally concentrating on working with 
their groups. The extremely low an«>unts of any kind of Sodal/Emotional talk indicate that 
the students did very little losing or insulting. 

The Procedural Nondirective, Acalemic Low-Level, and Individualistic Off-Task 
verbal interaction content subcategories comprise the major part of their respective general 
categories. For the Procedural category, this is encouraging, as it suggests that students' 
interactions could be characterized as polite or considerate (Nondirective) as opposed to 
authoritarian (Directive). The ^tremely low level of Closure talk (.74% of utterances) is 
also encouraging. This indicates that the tendency observ;^ during some of the field 
observations for the snidents to immediately vote on member' ideas rather than di^ussing 
them in grea^ detail and depth was not a widespread tendency. However, all Procedural 
talk is at best, unrelated to achievement for the speaker, and is predictive of nepdve 
achievement for the receiver if s/he needed a High-Level explanation (Webb, 1988). So 
while Procedural talk may serve to move the group along toward c(Hnpledng its academic 
task, it does not of itself offer potential for cognitive gain. 
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The breakdown of the Academic content c&tegofy into its subcategories indicates 
that the preponderance of Academic talk was conqmseddT Low-Level talk (90.95% of 
Acadonic utterances/ 74.21% of wofds). Ac»ianic Low-Level talk is limited in its 
prediction d mMcvewmt for the speaker as well as &e listener (Newmann & Thompson, 
1987; Webb, 1988). A positive a^Jcct erf the Low-Level talk observed is that much of it, 
especially the longer utterances, consisted of students reading orally. This reading often 
consisted of text which d^ stuc^ts h^ written themsdves. As noted, oral reading can 
^Mitribute to decoding ddlls (Mil. 1979) and osnprehension (Pfcrfetti, 1985). 
Unfortunately, this reading of students* written products was sel(k)m followed by analysis 
or critique, as evictenced by the low amounts of High-Level talk. High-Level interactions, 
which are strongly predictive of achievement for die speaker and inodcratcly so for the 
recipient comprised a fairly low anwunt of total discussion in student groups (3.61% of 
utteraiK^es/ 11.05% of words). The greats mean length of Acadcnuc High-Level 
utterances con^arsd with all other content subcategories indicate that when students did 
speak at high cognitive levels, they did so in utterances which w«e <rf sufficient length to 
suppon explanation erf" complex reascming. The modest amount of Academic requests 
(2.92% of utterances) suggests that students did not rely much on their p^rs to provide 
explanations of academic ccmtcnt Strategic questions regarding comprehension of text 
(Palinscar & Brown, 1984) were rarely observed; rather Academic Requests ien<kd to be 
solicitations of simple acatkmic content explanations such as, "How do your spell 
dungeon?" Such questions and their answers are quite limited in tiieir prediction of 
achievement gain for both participants in the exchan^ (Webb, 1988). 

I 

The Individualistic categcay of interaction content was composed of greater 
amounts of Off-Task than On-Task utterances, although the difference was statistically 
nonsignificant, and negligible in terms of words (2.70% and 2.42%, respectively). In 
genCTal, the low levels of both Individualistic Off-Task and Individualistic On-Task talk 
suggest tiiat die students in this study were quite task-oriented as well as group-oriented. 
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The low amount of Off-Task talk indicates that elementary students can and will stay 
on-task (StaUings, 1980) in cooperative reading groups, which is a positive finding 
when compared with other studies of reading follow-up activities (cf. Anderson, Bnibaker, 
Alleman-Biooks & Dufify, 1985). 

The general distribution of talk in these obsavations indicates that students were 
enpging in at least minimally ^^ptable types of discussicsi the great maj(Hity the time. 
Gc»nbining mean percentages of die undesirable typ^ of talk - Individualistic On- 
Task, Individualistic Off-Task and SociaiyEmotional Negative- yields an "Undesirable 
Talk" talk total of 8.35% of utterances and 5.29% of words. So. for nearly 95% of their 
total discussion time (by word data) iiese students were engaging in behavior that is well 
within the standards of acceptability for most clasmxjns. This indicates that these students 
w«e functioning quite weU in terms of monitoring dieir social relations and their attention 
to their task (Como, 1989). However, the general lack (^High-Level Academic talk points 
to an area where substantial improvement might be gained in these group discussions. The 
work of Palinscar and Brown (1984, 1985) and 01>onnell, Dan^reau and their colleagues 
(cf. O'Donnell, Dansereau, Hall, & Rocklin) offer models for develc^ing strategic 
discussion skills for cooperative groups. Such training in cognitive discussion skills might 
ccHitribute to more Academic High-I^vel veital interaction than was observed in this snidy. 



Interaction Content and Form by Grade and by Teacher 
The lack of teacher effects on interaction content, plus the crossing of teacher aiK. 
grade-level in Grade 4 (which had the most omsistent grade-level effects for content and 
form) suggests combining the discussion of these two types of interaction effects. Grade- 
level effects generally showed that students in Grades 3 and 6 engaged in cooperative 
group interactions of a nx)re desirable nature tfian students in Grade 4, both in terms of 
content and form. Considerable scrutiny is r»)uircd to infer potential sources of these 
grade-level effects since many of tiiem defy obvious (tevelopmental explanations. It 
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appears that the con^t and form of student interactions observed can be explained in tmns 
of the tasks upon which students were w(»-king in atWticm to their developmental level or 
age. 

Grade-level analyses indicated that Oade 4 was sf gnificantiy tower in overall 
utterance length than Grades 3 arni 6, which is ccHisistent with the higho- Ptoc^ural 
orientation and Iowa* Acaikmic oii«itadon fcs* Grade 4. In essence, the fourth graders in 
this study talked 1^ stxategicaUy than dui their third and axdi grade countoparts by 
focusing on I^tx^ural issues radier tiian Acad^nic content The @[B£te-level diffoences 
on the Procedural content subcategcmes show Grade 4 higho* than Grades 3 and 6 on 
Nondirective talk and higher than Grade 6 on Directive talk. The greater directivencss for 
fourth gratte compared with sixth graders is consistent with those of Wilkinson and her 
colleagues (Wilkinson & Calculate, 1982; Wilkinson & SpineUi, 1983) who found that 
students* likelihood of being dir«nive declined by gyade-lcvel in peer woric groups, 
although their Direct Fonn category was broader than the Procedural Directive category of 
this study, including specificity of intent as well as imperative form. 

The analysis of interaction content subcategories indicates that the differences 
between Grades 3 and 4 on Academic talk were dissimilar ftom those between Grade 6 and 
Grade 4. The ScheffS^ tests indicated that Grade 3 was higl^ than Grade 4 on Low-Level 
talk while Grade 6 was superior to Grade 4 as well as Gnide 3 on High-Level talk. The 
greater amount of High-Level talk for Grade 6 fits a dcvetopmaital intopretadon, while tiie 
greater (mentation of Grade 3 than Grade 4 toward Academic talk does not. The 
significantly greater percentages of Acadenic Requests in Grades 4 and 6 ojmpared with 
Grade 3 are puzzling. It may be that the nxm mature students were more socially 
competent in soliciting help when needed Or it may be that the third graders wse simply 
less confused by the tasks in which they v/ert oigaged. Again, there was a l^k of teacher 
effect for all these variables. 
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A deveioptnental inteipretadon can explain ^ greater dkecdveness (Procedural 
Direct) for Grade 4 students compared widi Graite 6 stiKients, as noted. Also, the higher 
levels of Academic Reqi^sts fra- Grafes 4 and 6 may be influence by these student' extra 
year or years sociaHzadon into schooling, (foweva, attributing to devtiopmem or age 
the greata" amount of Acadonic High-Le\^ talk dis^ved fen* Grade 6 students over 
Grades 3 and 4 appears to be an ov^rsimplificatkm, since Grade 3 was significantly higher 
dian Grade 4 on gen^ Academic and Acad»mc Low-Level talk. No c^er findings from 
this study lend themselves to a purely de\^<^nnental/years socializadon explanation. 

The distribution of students' talk among tf» Procedural and Ac^iemic categories 
and subcategories of discussion content s^ms most related to the teachers' choices of tasks 
for the classroom sessions observed. An examination of the tasks being engage^ by 
students in e^h of the classrocsns helps to explain die uniqueness of tiie verbal interactions 
of the Grade 4 smdents^. 

T'e students in both die Grade 4 classes were taught by Teacher 3. Both classes 
were just beginning an activity designed to last two ^ more weeks in which they were 
designing "The DragCHi Game", a board game to be played by class members. As players 
advanced around the board, they would encx)unter "hazards" designed by die various 
cooperative groups. These hazards would r^juire players landing on tiiem to complete 
various ^^ademic, artistic ch* physical activities. Cooperative groins w«e to develop a 
theme and tide f(x their hazard, select the activities, write instmcti(»is and establi^ 
evaluati(m criteria. Sinc» observations were ctmducted toward the beginning of the Dragon 
Game activity, these students were primarily concerned widi procedural issues. They were 
trying to ascertain exacdy what was expected of Uiem, and to choose names for their 
hazards. P^aps the great lengdt of die Dragon Game project, along widi die wide range 
of decisions fac^ by each group w^ so daunting diat the students reduced die complexity 
of dieir task by focusing on its simplo* pro^ural a^iects rather than its acad^nic aspens. 
This is consistent with Blumenfeld and Meece's (1988) statement reg<iniing dieir study of 
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science instructi<»i, tfiat. Tasks that are too procedurally complex may distract students' 
attention away from cognitive components (rf lessons (p. 247).** The students may have 
begun to engage in toon academically cmented discussions fartho* into the Dragon activity, 
however, durnig the endie week in which ob^rvations were ccmductoi fc»- this sttKiy, the 
Grade 4 students primarily focused on Procedural issues. Nomlirsctive talk (55.99% of 
uitCTances, 5? 74% of words) compris^i the majority of Grade 4 talk, resulting in the 
significantly higho* p^centage of Procedural tak, and significantly lovm pmrentage 
Acad«nic talk compared with Grades 3 and 6. The shtntra- mean utterance length f(x 
Procedural talk compared with Academic talk contributed to the Grade 4 students* mean 
utterance length being sh{»ter than that of Grad^ 3 and 6 as well. 

The students in the two Grade 3 clasaooms, working with Teachers 1 and 2, were 
engaged in the same task during all three obs^vations. These students were to rewrite one 
of Aesop's Fables into play fcHtnat, tape record their version of it, then perform it on finger 
puppets few classmates and second graders using their taped soundtracks. While many of 
these stuiknts' verbal interactions concerned procedural issues such as who would hold 
which puppet, a majwity of their talk was Acad«nic (53.21% of utterances). 
As noted earUer, a majority of the third grades' talk was Academic Low-Level (50.44^ of 
utterances), resulting in their being significantly higher than Grade 4 on this variable. 
Again, much of this talk consisted of the students reading aloud from their play scripts, 
rehearsing and revising. The long passages of oral reading among Grade 3 interactions 
contributed to their »gnificantly greater mean utterance lengdi con^ared with Gsade 4. 
Even though their talk was composed primarily of Low-Level Arademic intcractbn, the 
Grade 3 students were likely to have gained max cognitive benefit from their tasks during 
the lessons observed than the Proceduraliy-oricntcd Grade 4 students. Training in strategic 
discussion skills (Palinscar & Brown, 1985: CyDonnell, et al, 1987) might contribute to a 
greater percentage Academic High-Level talk for tfwM students, particularly in the fomi of 
critiquing each others' writing. 
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The significantly higher amount of Acsdeadc talk for Grade 6 compared with Grade 
4, along with the hi^io* anxMint of Acactemical High-Level talk compared with both Grades 
3 and 4 suggest son^deveif^miental effect The long^ utterance in Grade 6 con^iaiied 
with Ors^ 4 could be attributed to mapls devek^mental diffavnc^ were Gr^ 3's 
utterances not Icmger dian Grade 4's as well While there may be smtc develqimental 
influence m the hi^ier asxKHint d Academic High-Level talk Grade 6, it also appears 
that the tasks in which these students were engaged contributed to their relatively more 
strategic talk. The two Grade 6 classrooms engaged in different tasks from each other. 
Tasks engaged by students in Teacher 4's class were: analysis of characters in trade books 
using a concentric circles diagram to represent their relative importance during <mt 
observad(»t; and planning fo^ an elementary school m«nory book during the second and 
third obs»vati(»is. Students in Teacho- S's class enpg^l in a different activity during each 
observation: analysis of trade bode charact^ by compiling and OTganizing clippings from 
magazL^es to represent traits; a "new^per scavenger hunt", involving fmding particular 
types of infonnation and structural features in newspaps^; and brainiicmiing ideas on how 
to write stories based on their second-grade book-pals' interests. Each of the activities 
engaged by both the Gracte 6 classes offered the opportunity for the students to focus on 
Academic ccmtent at least at a low-level, and possibly at a high-level. The Grade 6 students 
engaged in interactions consistent with the nature of their tasks; these interacdons were 
compel of fairiy long utterances with a mo<tote amount of Academical High-Level talk. 
Again, training in strategic discussion skills (PaUnscar & Brown, 19SS; O'Donnell, et al, 
19S7) mi^ improve the quality of the di»;ussions in these classes. 

Conclusions 

The elementary ^hool students in this study focustti on their groups' tasks as they 
perceived them a great deal of the time. This is reflected in the high amounts of Procedural 
and Academic talk and the bw amount of Individualistic Off-Task talk observed. These 
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students worked with their groups a gpcai majrarity oi the time as evidenced by the low 
amount oi Individualistic talk. In additicm tii^ engaged m minimal antagcmistic intoacrion 
as indicated by die extrm^y low amc^int SodaVEmotscmal Neptive talk. The on-task 
(Stallings, 1980) and mm-negative nature of ttese stiMients' (^>operadve group discussions 
are quite p(^tive findings. So too, is die for higher amount of Acatfemic talk found in this 
study compared with Kalkowski's (1988). 

The pattmis of poup content and fosm verbal intmction ol^erved appearKi to 
be more closely associated with learning tasks than with die age developmental level 
the students. A potentially firuitful line of inquiry then, would be to examine how carefully 
structured instructional tasks couM be us«i to increase the strategic ctmtent of students' 
coopwativc group discussions. The low amounts of Acastemic High-Level interaction 
content observed in Grattes 3 and 4, and the relatively modest amounts of High-Levcl 
c<»itent in Grade 6 pram to an area in which coqjCTative group discussions could be 
substantially improved. Palinscar Brown (1984) and O'Donnell, et al (1987) offer models 
for promoting strategic discussion in cooperadve groups. 

This study offers a glimpse <rf students' discussions in cooperative learning groups 
during their regular literacy instruction. Cbntent and form of vai^ interactien provided a 
lens for understanding how cooperative group discussions can facilitate as well as inhibit 
oi^>ortunities foe students to leam. In addition, acmiemic tasks appeared to play an 
important role in renting students' discussions toward procedural or academic content 
While the small sample size ami the shcnt duration of this study limit the geneiBlizability of 
findings, die naturalistic st^ng enhances its internal validity. Furdier naturalistic smdies 
are needed to describe and interpret cooperative learning discussions as they are conducted 
by students in a wkle variety of classrocmis in cndo- to build an und^standing of 
cooperative learning in practice. 
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The autlK»^ would like to thank Michael Bkxto for coding the transcripts fen- this study, 
and Choyl Brumbaugh, M Elizabeth Gimxe, Kenneth Hopkins and Lew Rcmiagnano 
fen- their inMght on technical ami ccmcqmial issues. 

^ The t»ms **coopmtive learning'*, "peer work groups", and "cooperadve groups" are 
defined in various ways by different authors. Since the purpose of this study is 
de«^ptive, and the type of instruction observed was entirely of the participating 
teachers' choosing, these terms will be used interchangeably, just as they are by many 
practitioners. 

2 The terms "v«bal interaction", "discussicm", and •*talk" will be used interchangeably to 
refer vo verbal ccnnmunication in a general fEishion. 

^ For a task framew^k (Doyle, 1988) analysis of this data, see Meloth & Deering, 
(under review). 
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TMoaomv af Yartial Itttermctlaii Oaiitant 
t. Ppocedural (PRO) 

^ Won-difactiv (PNH) — CMumts« sufgntioot or quMtioas o& tht §fwp'a or 
«s iD^vt^teftft tcthai. 

Ettfli^: "Arovesopp^odtodo juroviK^justtttmiiioaor 

b. Bifoctiro (PD) ~ Afl order on how the group or an individuaJ should tel. 
Ettmjilo: "No* vritoAflory front tad teck." 

€. Attamnta at clomra CPQ.~ A suh^gorf under tSin€iiw9 tad ms-difvciifv 
/in^rMlei«/«£fiRnis<i0^ Effort ^ 
particulir topic to aa end. 
£iampfo: t^Jet'tToter 

2. Acadamic Cofttont-Reiaiad (ACA) 

Low-lo^i CACL) - foovidiag ft simple aasver or uaeiplftiiied ite or reading 
ftloud from ftmiliftr l^. 
Enmpie: "li't^tlkd. J-E-V-E-L-S." 

b. Big[|dtalL(ACi)--EKplaiAingftprocMorntetsproc«sfcorprorMing 
iuitiflcstion for an opinion. 

Enuipit: 'I Uiifi!: ^t's tfeit n^ importnat Uhftmtcr ia tho iterf] 'cauei 
•mfbo^ alvays takod her adrict* 

c. BaaMaia ftif a cadaaiic eofHant lAt!?! - Solicitation iafbrmatiea fftoted to 

tha group's ac«lamic taii. 
Eiampto: 'Vbal'aabr'liaot' 
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IftUt-L 

3. Ifldiviihi>listic»MD) 

ft. ftidhridtiAiifitSfftB-to^Bfc .. Uttanukces liidicttins thti an indnrldusl 
intoiids to vork oo tlk« group's task alooe. 
Extmplo: "I'll do drsfon questions since I ova the book." 

b. ladividuatisac Off>tesk (I-Off) » UUenam that tre uareUted to the task 
and/or to the group. 

EnjBple: "I'm going to the basketbaJJ game toaight." 

4. Social/Emotioii^ (SOC) 

a. Positive affect (S£« ) -- Coflipliffleats, empathy, f aciUtaUon of the group 

process. 

Eiample: 'Noaliitear 

b. Neaatiye affect (SE-) - lasuits. criUcisms of an iadividual ir her/his ideas. 
Eiample: That's duffibt" 
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MffM PgrwaUgW (mtf Sfnto< P(fvimiion«> of PtUira n cei antf Wards 
of Gttttfal ?ef hml fnteraiiiiDa frff fltff Ht Cttff gqflM 





PRO 


ACA 


m 


soc 


Utt 




42.22S 


7.831 


t.59)l 




(22.46) 


(24.(^) 


(8.99) 


(2.00) 




40.83« 


53.I6S 


5.12J8 


.69SI 




(23.06) 


(24.35) 


(6.54) 


(.56) 



UU - UU«f&Qce f d • Wofd 

Pro -Procedural ACA « Academic IND - ladhridii&ilstic SOC • Social/Eiaotioiial 



MCM Pgf MftUies Cmd StAndrd DerimUQaal of Utimr^emit f j| 
of Yofb»l IflteracUoa tonUiat S^b cateMf 



PHD PD PCI ACL A(ai AC? i-On i-Off SC» SE- 

Utt 42.0I« 5.628 0.74JI 35.6811 3.6i;8 2.92« 2.65JI 5.I8« I.07I 0.52« 

(20.52) (4.74) (1.23) (24.60) (7.13) (2.84) (4.10) (7.70) (1.29) (1.13) 

Wd 37.13« 3.36S 0.3451 39.45« 11.0511 2.66S 2.42S 2.10% 0.52J8 0.17« 

(22.26) (3.72) (.679) (21.38) (17.87) (4.07) (430) (4.87) (.54) (33) 



Utt-Uttenuce fd-Yord 

PiW - Procedural No&directiTe 
PD - ProcMturai Directive 
PQ • Proce^nd ^c^re 
ACL • Academic (bfltent Lov-Lerel 
ACH • Academic ConteDt fitgh-Lerei 
AC? » Aouiefflic (kmtefit Request 
I-<hi « IfidhrkNtti^c (hi-T«sk 
I-Qff * IadiviAiali^( m-Ttsk 
SE« -Sociai/Eniotlonal Poaithre 
SE- -Social/Elliot «al Negatire 
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Mean PerceftUafti (ind StmmUrd PeTiftilQiial gf flUarmMCB^ 



GRADE 


PRO 


ACA 


m 


SOC 


3 


39.92SI 
(39.92) 


53.211 
(53.21) 


5.932 
(6.76) 


0.952 
(.99) 


4 


66.01 i 
(66.01) 


22.742 
(22.74) 


9.452 
(10.63) 


1.802 
(2.12) 


6 


37.84SI 
(37.84) 


51.142 
(51.14) 


8.672 
(10.31) 


2.352 
(2.70) 


- Utteraace 


Wd«Word 









Pro « Procedural ACA - Academic IND « ladividuftUsUc SOC • Sociai/EmoUoaai 



Meaa PercenUaef (and Slaadard PeTlatiena) of Ptiefaacea 
ia lateracUen Coatant Sabcataf or iea hw Cfade-Lacrl 




erade PHD PP PCI ACL ACSa AC? l-to i-Off SE» SE- 

3 33.892 5.712 0.612 50.442 1.582 1.192 3.462 2.472 .832 0.122 
(22.54; (3,70) (.607) (28.47) (2.30) (1,82) (4.97) (4.09) (1.00) (.24) 

4 55.99? 8.742 1.272 17.482 1.302 3,972 0.562 8.682 .942 0.862 
(13,39) (4.72) (1.27) (9.73) (1.90) (2.79) (1.37) (889) (1.04) (1.50) 

6 35.972 1.642 0.232 36.742 10.122 4.292 4.202 4.472 1.892 0.692 
(16.29) (3.33) (.23) (15.05) (12,10) (3.07) (4.33) (6.36) (1.89) (1.34) 

Utt • Utterance Wd - Word 

PND - Procedural NoadirectiTo 

- Procedural Diredhre 
PCI - Procedural Closure 
ACL • Academic Content Low-Level 
ACH - Academic Content Eiglt-Level 
AC? » Academic Content Sequesi 
I-Qn - IndividttaU^c Qs-Task 4 Q 

I-QfT • Individualize (tfT-Task 
SE* -Social/EfflotioaalMttve 
SE- -Social/Eaotionat Negatire 
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I k 



CoopertSive Intertctions 



Mm Per eefltogea (and St«i<Urd Pevitioiial of Pltaraacgs 
ia ?ef hml IntermcUon CoaSant Cenerml Categories Teacher 



Teacfser 


PRO 




IND 




1 


43.0811 


50.581 


5.40X 


0.95X 




(14.22) 


(11.54) 


(4.62) 


(.43) 


2 


37.94f 


54.85f 


6.27« 


0.948 




(28.02) 


(33.07) 


(8.10) 


(1.25) 


3 


66.01 X 


22.74JI 


9.45JI 


1.80X 




(13.20) 


(11.70) 


(10.63) 


(2.12) 




39.1 OX 


55.76X 


3.89X 


1.26« 




(17.89) 


(20.71) 


(4.30) 


(1.03) 


5 


36.591 


46.52X 


13.46SI 


3.44« 




(20.88) 


(12.77) 


(12.98) 


(3.58) 



Pro « Procedural ACA • Academic IND « ladivlduaiistic SOC - Sociai/Efflotional 



ERIC 
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ff 



Cooperathre lAtemtioas 



itt IntaracUon Conteiit Sahctayriei hw Tamchof 



Teacfrar 




PD 


PCI 


ACL 




AC? 




l-Off 


SE4 


1 


34.97« 
(16.49) 


7.291 
(3.43) 


0.821 
(1.06) 


47.521 
(11.22) 


1.9tl 
(1.35) 


1.141 
(.68) 


3.231 
(3.07) 


2.161 
(2.40) 


0.68 
(.51 


2 


33.2251 
(26.63) 


4.251 
(3.55) 


0.471 
(.62) 


52.261 
(36.17) 


1.371 
(2.81) 


1.231 
(2.32) 


3.601 
(6.07) 


2.671 
(5.03) 


0.92 
(1.2* 


3 


55.99« 
(13.87) 


8.741 
(4.72) 


1.271 
(1.82) 


17.481 
(9.73) 


1.301 
(1.90) 


3.971 
(2.79) 


0.561 
(1.37) 


8.891 
(10.51) 


9.40 
(1.0* 


4 


36.181 
(12.94) 


2.651 
(4.64) 


0.271 
(.53) 


39.131 
(M.89) 


11.981 
(13.14) 


4.651 
(3.23) 


1.661 
(1.90) 


2.231 
(3.20) 


0.84 
(.98 


5 


35.761 
(21.26) 


0.631 
(1.27) 


0.201 
(.39) 


34.351 
(17.08) 


8.251 
(12.64) 


3.921 
(3.36) 


6.741 
(4.78) 


6.711 
(842) 


2.48 
(2.3- 



Utt-Uttenuice Wd-Word 

PNB - ProcedunU Nondirective 
PD -ProceduraJ Directive 
pa ■ Pmcedurii Closure 
ACL - Actdemic Content Lov-Level 
ACH • Actdemic Content Higb-Lerel 
AC? ■ Actdemic Content Bequest 
I-Ofl - Ifidividutllstic On-Ttsk 
I-Off - Indiridutlistic OfT-Ttsk 
S£* •Socitl/Emotiontl Positive 
SE- -Socitl/Emotiontl Negative 
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ERIC 



Coop9rative Intenctions 



EUucsJL 



t^&n P^xentagss of Utterances of Int^^tfon Content Subcategories 

Over All Ote^at ions 



50.00)S T 



40.00J5 - 



30.00X - I 



li^ % Utts 




PND 



I \ \ 

PD PCI ACH AC? l-to l-Off SE+ SE- 

tntrsctfon Cont^t Sut^^tegtr ies 



Le gend 

UUs-UUersAces 

PND • ?roceitunt NondimUre 
PD • Procedurtl Directive 
PQ - Procedunl Closure 
AQ. - Academic ConleAt Lov-Level 
ACH • A^ffiic Goatf at Big h-Levet 
AC? - Acadeffiic Goateiii Request 
I-mi -IndiridttsU^c Oa-Tesk 
I-Off - 1 ndiridutlisUc (^-Tesk 
SE« -Sociil/EffiottootlPesithre 
SE- * Socttl/Efflotional Negelive 
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« 



Coop«miv« InUrsctioos 



EUiict-2 



Mean P&t&AtgBS (rf Utteranoes of Interoctton Content Subcstegortes 




PND PD PCI Aa A(>l AC? I-On l-Off SE* SE- 



tnteractfon Ccmtent $ut»»tegorfes 



Legend 
Utt-Uttenac9 

PND * Procefiuni NondirecUTe 
PD • Procedura! Directive 
PCI • Proce^ni Q<mire 
ACL • Ac«demic Cootent Lov-Level 
ACH - Actdemic Content Eigh-Level 
AC? - Acsdemic Content Request 
I-On - IndividuiUstic On-Task 
I-Off - IndividutUsUc OfT-Ttsk 
SE* - Sociil/Emolionnl Positive 
SE- - Social/Emotionnl NegtUve 
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Cdoportllve Intenctions 



FreQB^iicv IHrtHfciiUoa of Pitaranca LenatAa 

Acrwi All Obwintiff fli 




to 15 20 



4S 
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C»dper»Uv9 IftterAcUoas 



Mean Utteranoe Lengtt» of Intractfon Contmt Sutnateyr fes 



Words 



25 J 
20 ■■ 
IS.. 
10- 
5-- 



PND PD PCI Aa ACH AC? I-On l-Off SE+ S£- 

Interectton Oont^t SuMegorfes 



Leygnd 

PND - Procedurtl NondirecUve 
Pt • Procedural Cirtctive 
PCI - Proceikinl CIo»ire 
ACL - Acadeiaic Oonteai Lov-Uvel 
ACH - Acadeoiic Coateot Hi|h-Uvel 
AC? - Acsdemic Coatent Request 
I-On • iQdiridiMlisUc Oa-Tt^ 
I-Off . lodhriduftUstic Off-Task 
SI* « SocialZ&aotioaal h^vc 
SE- « SociaiyEfflotiooat NacaUva 
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